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[Document] SPECIFICATION 

[Title of the Invention] COLOR IMAGE DISPLAY SYSTEM 

[What is claimed is:] 

[Claim 1] A color image display system characterized by 
comprising : 

a plurality of partial color image display means for 
displaying each of partial color images to be synthetically 
displayed as a color image of one frame, on the basis of 
respective display color image data being input; and 

image data conversion means for converting input color 
image data into the display color image data being input to 
each of the partial color image display means, characterized 
in that 

the image data conversion means includes color correction 
means for correcting a difference in a color reproduction 
characteristic of each of the partial color image display 
means . 

[Claim 2] The color image display system according to 
claim 1, characterized in that the color correction means has 
data acquisition means for acquiring data used for correction 
of the color reproduction characteristic. 

[Claim 3] The color image display system according to 
claim 2, characterized in that the data acquisition means 
includes at least any of a spectrophotometer, image sensing 
means, a color difference colorimeter, and an illuminance 
meter . 

[Claim 4] A color image display system characterized by 
comprising: 



a plurality of partial color image display means for 
displaying each of partial color images to be synthetically 
displayed as a color image of one frame, on the basis of 
respective display color image data being input; and 

image data conversion means for converting input color 
image data into the display color image data being input to 
each of the partial color image display means , characterized 
in that 

the image data conversion means includes correction means 
for correcting a bias of the input color image data so as to 
display the partial color images on a predetermined set bias 
in the partial color image display means. 

[Claim 5] A color image display system characterized by 
comprising : 

a plurality of partial color image display means for 
displaying each of partial color images to be synthetically 
displayed as a color image of one frame, on the basis of 
respective display color image data being input; and 

image data conversion means for converting input color 
image data into the display color image data being input to 
each of the partial color image display means, characterized 
in that 

the image data conversion means includes 
data distribution means for distributing color image data to 
be input to the display color image data to be input to each 
of the partial color image display means, so as to display, at 
a predetermined ratio in an overlap region, each of the 
partial color images contained in the overlap region of the 



partial color images displayed by said partial color image 
display means. 

[Claim 6] A color image display system characterized by 
comprising : 

a plurality of partial color image display means for 
displaying each of partial color images to be synthetically 
displayed as a color image of one frame, on the basis of 
respective display color image data being input; and. 

image data conversion means for converting input color 
image data into the display color image data being input to 
each of the partial color image display means, characterized 
in that 

the image data conversion means includes nonunif ormity 
correction means for correcting color nonunif ormities in the 
partial color images displayed by the partial color image 
display means. 

[Claim 7] A color image display system characterized by 
comprising : 

a plurality of partial color image display means for 
displaying each of partial color images . to be synthetically 
displayed as a color image of one frame, on the basis of 
respective display color image data being input; and 

image data conversion means for converting input color 
image data into the display color image data being input to 
each of the partial color image display means, characterized 
in that 

the partial color image display means is configured to 
have lower display luminance in an overlap region between the 



partial color image displayed by one partial color image 
display means and the partial color image displayed by another 
partial color image display means than in a remaining region. 

[Claim 8] The color image display system according to 
any one of claims 1 to 7 , characterized in that 

the partial color image display means includes a multi- 
primary-color display having at least four primary colors. 
[Detailed Description of the Invention] 

[0001] 

[Technical Field of the Invention] 

The present invention relates to a color image display 
system and, more particularly, to a color image display system 
having an image data conversion apparatus which converts input 
image data into display color image data to synthetically 
display partial color images displayed by a plurality of 
partial color image display apparatuses as a color image of 
one frame. 

[0002] 

[Prior Art] 

In recent years, a color image display system for 
synthesizing display images by a plurality of projectors and 
displaying one precise and large image has been proposed and 
put into practical use. More specifically, the system 
projects and displays partial color images on a screen using 
a plurality of projectors, thereby synthetically displaying 
a color image of one frame on the screen. 

[0003] 

In such a system for displaying a color image of one. 



- 5 - 

frame by synthesizing display images by a plurality of 
projectors, a pixel position shifts or reproduction luminance 
changes occur between display images by the projectors due to 
geometric distortion or luminance difference between the 
projectors. Additionally, since this system generally 
synthesizes the display images by each of the projectors by 
making them partially overlap, color misregistration occurs in 
the overlap region due to the adjustment error in each display 
image . 

[0004] 

Conventionally, to solve these problems, the geometric 
distortion is corrected by adjusting the projection position 
of each projector or correcting image data, and color 
misregistration is corrected by correcting image data in the 
overlap region between the display images by the projectors. 

[0005] 

[Object of the Invention] 

However, according to examinations by the present 
inventors, only the above-described geometric distortion 
correction and color misregistration correction in the overlap 
region between the display images by the projectors are 
insufficient to finally synthetically display a color image of 
one frame with satisfactory quality. 

[0006] 

It is an object of the present invention to provide 
a color image display system capable of synthetically 
displaying a plurality of partial color images as a color 
image of one frame with satisfactory image quality. 
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[0007] 

[Means for Achieving the Object] 

In order to solve the above problems, according to the 
present invention, in a color image display system 
characterized by comprising a plurality of partial color image 
display means for, upon receiving display color image 
data being input, displaying partial color images to be 
synthetically displayed as a color image of one frame, and 
an image data conversion means for converting input color 
image data into the display color image data to be input to 
the partial color image display means, the image 
data conversion means or partial color image display means is 
designed to have the following arrangement. 

[0008] 

(1) The image data conversion means has a color 
correction means for correcting the difference in a color 
reproduction characteristic between each of the partial color 
image display means. With this color correction means, even 
when the plurality of partial color image display means have 
different color reproduction characteristics, displayed colors 
match in the entire color image synthetically displayed as one 
frame. Hence, discontinuous connected areas between the 
partial color images are eliminated, and a high-quality color 
image can be displayed as a whole. 

[0009] 

(2) The image data conversion means has a correction 
means for correcting a bias of the input color image data so 
as to display the partial color images on a predetermined set 



bias in the plurality of partial color image display means. 
When the correction means for correcting the bias is provided, 
a case in which the display color image data input to the 
partial color image display means has a value smaller than the 
bias and cannot be reproduced is eliminated or reduced. 
[0010] 

(3) The image data conversion means has 

a data distribution means for distributing the input color 
image data to the display color image data to be input to the 
partial color image display means so as to display, at 
a predetermined ratio in an overlap region, the partial color 
images contained in the overlap region between the partial 
color images displayed by the partial color image display 
means. With this data distribution means, even in the overlap 
region where the partial color images by the plurality of 
partial color image display means overlap, a desired color can 
be accurately displayed. 
[0011] 

(4) The image data conversion means has a nonunif ormity 
correction means for correcting a color nonunif ormity in 

a partial color image displayed by the partial color image 
display means. When the partial color image displayed by each 
partial color image display means is corrected by the color 
nonunif ormity correction means, high-quality display is done 
in each partial color image, and also discontinuous boundaries 
between the partial color image due to the color nonunif ormity 
which changes in units of partial color image display means 
can be prevented. 
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[0012] 

(5) The partial color image display means are designed to 
display the partial color images with display luminance lower 
in an overlap region between the partial color image displayed 
by one partial color image display means and the partial color 
image displayed by another partial color image display means 
than in a remaining region. When each partial color image 
display means has such a design, an increase in bias in the 
overlap region can be eliminated or reduced. 

[0013] 

(6) As the partial color image display means in (1) to 
(5) , a multi-primary-color display having at least four 
primary colors may be used whereby a wider color reproduction 
range can be realized. 

[0014] 

[Embodiments of the Invention] 

Embodiments of the present invention will be described 
below with reference to the accompanying drawings. 
(First Embodiment) 

FIG. 1 shows a color image display system according to 
the first embodiment of the present invention. This color 
image display system includes an image input apparatus 1, 
image data conversion apparatus 2, projectors 3A and 3B, and 
screen 4 . 

[0015] 

The image input apparatus 1 obtains, as input color image 
data, image data having three channels for RGB (red, green, 
and blue) per pixel, which is obtained by sensing an object 
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using, e.g., a digital camera. The image input apparatus 1 
has a sensitivity characteristic linear with respect to 
luminance, and the input color image data is also linear with 
respect to luminance. The input color image data obtained by 
the image input apparatus 1 is output to the image 
data conversion apparatus 2. 
[0016] 

The image data conversion apparatus 2 converts the input 
color image data from the image input apparatus 1 into display 
color image data for the two projectors 3A and 3B serving as 
partial color image display means and outputs the image 
data to the corresponding projectors 3A and 3B. 

[0017] 

In this embodiment, each of the projectors 3A and 3B is 
a 3-primary-color projector using RGB colors, which projects 
and displays a partial color image on the screen 4 in 
accordance with the display color image data input thereto. 
The partial color image displayed on the screen 4 by the 
projector 3A or 3B will also be referred to as a partial 
display image hereinafter. Each of the partial display images 
is synthetically displayed on the screen 4 as a large color 
image of one frame (also to be referred to as a synthesized 
display image hereinafter) as a whole. In this case, the 
partial display images by the projectors 3A and 3B partially 
overlap on the synthesized display image on the screen 4, as 
shown in FIG. 1. 

[0018] 

The image data conversion apparatus 2 will be described 
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next in detail with reference to FIG . 2. The image 
data conversion apparatus 2 is constructed by color correction 
units 11A and 11B, geometrical correction units 12A and 12B, 
bias correction units 13A and 13B, data distribution units 
14A and 14B, and gray scale correction units 15A and 15B, 
which are prepared in correspondence with the projectors 
3A and 3B, respectively. The color correction units 11A and 
11B, geometrical correction units 12A and 12B, . bias correction 
units 13A and 13B, data distribution units 14A and 14B, and 
gray scale correction units 15A and 15B have identical 
structures. The arrangement of each part of the image 
data conversion apparatus 2 will be described below. 
[0019] 

[Color Correction Units 11A and 11B] 

Input color image data (input signal values R, G, and B) 
within image regions displayable by the projectors 3A and 3B 
are input from the image input apparatus 1 to the color 
correction units 11A and 11B. The input color image data do 
not depend on the characteristics of the projectors 3A and 3B. 
The signal values R, G, and B of these input image data are 
converted into unique signal values (called display signal 
values) suitable to display by the projectors 3A and 3B by the 
color correction units 11A and 11B in accordance with the 
color reproduction characteristics of the projectors 3A and 
3B, respectively. 

[0020] 

FIG. 3 shows a measurement system of the color 
reproduction characteristics of projectors 3A and 3B. On the 



basis of color image data output from an image output 
apparatus 5, single-color images of R (red) , G (green) , and B 
(blue) are projected onto the screen 4 by the projectors 
3A and 3B. XYZ tristimulus values in the maximum light 
emission of these single-color images are measured from 
a patch image 6 on the screen 4 by a measurement instrument 
such as a spectrophotometer 7, thereby obtaining the color 
reproduction characteristics of the projectors 3A and 3B. 
[0021] 

In addition, to measure the color reproduction 
characteristics, for example, an image sensing apparatus, such 
as a digital camera, may be used. In this case, single-color 
images of R (red) , G (green) , and B (blue) are projected onto 
the screen 4 by the projectors 3A and 3B on the basis of color 
image data output from the image output apparatus 5, and the 
images in the maximum light emission of these single-color 
images are sensed by the image sensing apparatus to obtain 
signal values, thereby obtaining the color reproduction 
characteristics of the projectors 3A and 3B. 

[0022] 

The color reproduction characteristics of the projectors 
3A and 3B obtained in the above manner are supplied to the 
color correction units 11A and 11B. The color correction 
units 11A and 11B convert the signal values R, G, and B of the 
input color image data into signal values (display signal 
values) R', G', and B' of display color image data by linear 
conversion represented by the following formula. 
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[0023] 
[Formula 1] 



(R'\ 




( x r x g x b " 






(R\ 


G' 




Y rY g Y b 




a 2l a 22 a 23 


G 


W 




lw» J 









[0024] 

Here, Xr, Xg, and Xb are X values in the maximum light 
emission by the signal values R', G', and B'. In a similar 
manner, Yr, Yg, and Yb are Y values in the maximum light 
emission by the signal values R', G', and B'. In addition, 
Zr, Zg, and Zb are Z values in the maximum light emission by 
the signal values R' , G', and B 1 . The color reproduction 
characteristics of the projectors 3A and 3B are represented by 
the X, Y, and Z values. Additionally, aij is an element of 
a matrix A for converting the input color image data R, G, and 
B into the XYZ tristimulus values. 

[0025] 

In addition, to measure the color reproduction 
characteristics, an image sensing apparatus may be used. In 
this case, as described above, single-color images of R (red) , 
G (green) , and B (blue) are projected onto the screen 4 by the 
projectors 3A and 3B on the basis of color image data output 
from the image output apparatus 5, and the images in the 
maximum light emission of these single-color images are sensed 
by the image sensing apparatus to obtain signal values, 
thereby obtaining the color reproduction characteristics of 
the projectors 3A and 3B. 



[0026] 

The color reproduction characteristics of the projectors 
3A and 3B obtained in the above manner are supplied to the 
color correction units 11A and 11B. The color correction 
units 11A and 11B convert the signal values R, G, and B of the 
input color image data into signal values (display signal 
values) R', G', and B 1 of display color image data by linear 
conversion represented by the following formula. 

[0027] 
[Formula 2] 
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[0028] 

Here, aij is an element of the matrix A for converting 
the input color image data R, G, and B into the XYZ 
tristimulus values. Further, Xr, Yr, and Zr are XYZ values in 
the maximum light emission of R (red), Xg, Yg, and Zg are XYZ 
values in the maximum light emission of G (green), and Xb, Yb, 
and Zb are XYZ values in the maximum light emission of B 
(blue) . These values are calculated by the following 
formula on the basis of the signal values output from the 
image sensing apparatus. 
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[0029] 
[Formula 3] 
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[0030] 

Here, a matrix M is a matrix ( chromaticity conversion 
matrix) for converting image signal values S obtained by the 
image sensing apparatus into XYZ values, and n is the - number 
of channels of the image sensing apparatus. The image signal 
value S is an image signal value obtained by the image sensing 
apparatus. For example, an image signal value Sri means the 
signal value of the first channel in the maximum light 
emission of R (red) . The chromaticity conversion matrix M is 
obtained in advance on the basis of the input/output 
characteristics of the image sensing apparatus. 

[0031] 

As an image sensing apparatus, a TV camera, digital 
camera, or multi-band camera having at least four channels can 
be used. In the above description, the image in the maximum 
light emission of each of the single-color images of RGB is 
sensed to acquire the color reproduction characteristics. 
However, an optional color image may be used as long as such 
color is a combination of independent signal values. 

[0032] 

In addition, if the above-described chromaticity 



conversion matrix M is not obtained, color correction of each 
projector is performed on the basis of the following formula. 

[0033] 
[Formula 4] 
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[0034] 

Here, a'ij is an element of a matrix A ' for converting 
the input color image data R, G, and B into signal values in 
a desired RGB space. The value S is a signal value acquired 
by the image sensing apparatus. For example, a signal value 
Sri means the signal value of the first channel in the maximum 
light emission of R (red) . 

[0035] 

FIG. 4 shows the detailed arrangement of the color 
correction unit 11A (11B) . The color correction unit 
11A (11B) includes a matrix calculation unit 21, matrix 
data storage unit 22, and matrix conversion unit 23. 

[0036] 

The above-described matrix A and color reproduction 
characteristic of the projector 3A (3B) are measured or set in 
advance and input to the matrix calculation unit 21. The 
matrix calculation unit 21 calculates a matrix for converting 
the signal values R, G, and B of the input color image 
data into the display signal values R', G', and B'. The 
matrix calculated by the matrix calculation unit 21 is stored 
in the matrix data storage unit 22. 
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[0037] 

In conversion, the matrix conversion unit 23 reads out 
predetermined matrix data from the matrix data storage unit 22 
and converts the signal values R, G, and B of the input color 
image data into the display signal values R' , G 1 , and B' on 
the basis of an equation shown in [Formula 1] . The matrix 
data stored in the matrix data storage unit 22 changes 
depending on a change in characteristics of the projector 
3A (3B) or in units of image input apparatuses 1. For this 
reason, the matrix data storage unit 22 can store/rewrite 
a plurality of data. In this manner, the color correction 
units 11A and 11B correct a difference in the color 
reproduction characteristics of the projectors 3A and 3B. 

[0038] 

[Geometrical Correction Units 12A and 12B] 
Next, the display signal values R', G', and B' output 
from the color correction units 11A and 11B are input to the 
geometrical correction units 12A and 12B. The geometrical 
correction units 12A and 12B perform geometrical correction on 
the display signal values R', G', and B' such that the partial 
display images are projected at correct positions by the 
projectors 3A and 3B. Details of the geometrical correction 
are disclosed in Jpn. Pat. Appln. KOKAI Publication 
No. 9-326981, and a detailed description thereof will be 
omitted here. 
[0039] 

[Bias Correction Units 13A and 13B] 

Next, the signal values R', G', and B' of the color image 



data geometrically corrected by the geometrical correction 
units 12A and 12B are input to the bias correction units 
13A and 13B. The bias correction units 13A and 13B set a set 
bias at each pixel position of the projectors 3A and 3B on the 
basis of actual bias data of the projectors 3A and 3B and 
position data of the overlap region between the partial 
display images by the projectors 3A and 3B, and corrects the 
biases of the signal values R' , G', and B' such that the 
partial display images are displayed on the set bias. Here, 
the actual bias means a color displayed when all the RGB input 
signals to the projectors 3A and 3B are 0. 
[0040] 

FIG. 5 shows the bias of each of the projectors 3A and 3B 
(actual bias of the partial display images by the projectors 
3A and 3B) and an example of bias distribution of the 
synthetic bias of the projectors 3A and 3B (actual bias of the 
synthesized display image). FIGS . 6(a), 6(b), and 6(c) show 
examples of a set bias. Referring to FIGS. 5, 6(a), 6(b), and 
6(c), the abscissa represents two-dimensional pixel positions 
(x, y) , and the ordinate represents a three-dimensional color 
space C. 

[0041] 

Referring to FIG. 6(a), a predetermined value equal to 
the maximum value of the actual bias of the entire display 
screen of the projectors 3A and 3B is set as a set bias. 
Referring to FIG. 6(b), near the center of the screen 
including the maximum value of the actual bias of the 
projectors 3A and 3B, the set bias is set to be equal to the 
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maximum value of the actual bias, and the set bias is set to 
be a value smoothly decreases toward the periphery of the 
screen. The maximum value of the actual bias of the 
projectors 3A and 3B means a bias with which the projective 
vector of a predetermined color vector (e.g., white vector) is 
maximi zed . 

[0042] 

When image data is displayed with a distribution on the 
set bias shown in FIG. 6(a) or 6(b), the image can be 
prevented from becoming dark and impossible to display because 
of the image data value smaller than the actual bias of the 
projectors 3A and 3B, or being clipped and displayed as 
an unnatural image. 

[0043] 

Referring to. FIG. 6(c), a set bias is obtained in units 
of pixel positions on the basis of the relationship between 
the actual bias in the entire display region of the projectors 
3A and 3B and all image data input to the bias correction 
units 13A and 13B. More specifically, a set bias is set such 
that the difference vector in projective vector to white 
vector (white axis) between image data and actual bias (i.e., 
the difference in color projected onto the white axis between 
image data and actual bias) is maximized. FIG. 7 
schematically shows the actual bias and image data, which are 
projected onto the white axis. 

[0044] 

Let B(x, y) be actual bias at each pixel position of the 
projectors 3A and 3B, I (x, y) be image data corresponding to 
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each pixel position, and W be the white axis of the display 
image. Norms NB(x, y) and NI (x, y) of the projective vectors 
of B(x, y) and I (x, y) onto the white .axis W are given by 

[0045] 
[Formula 5] 

N B (x,y) = (B(x,y)-W)/\\W\\ 
N,(x,y) = (I(x,y)-W)/\\W\\ 

[0046] 

Here, • is inner product calculation, and |j || is the norm 
of a vector. A set bias is set as a vector in the direction 
of white axis W, which has a norm Nw at a pixel position (x, 
y) at which the norm difference AN(x, y) = NB(x, y) - NI (x, y) 
between the projective vectors is maximized, and is given by 

[0047] 
[Formula 6] 

B s =N W W/\\W\\ 

[0048] 

[0049] 

In the above manner, when a set bias is defined in units 
of pixel positions on the basis of the relationship between 
actual bias of the projectors 3A and 3B and image data input 
to the bias correction units 13A and 13B for actual display by 
the projectors 3A and 3B, color misregistration by the set 
bias can be minimized. In addition, generation of image 
data that is darker than the projective value of the set bias 
to the white axis and therefore cannot be reproduced can be 
avoided . 
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[0050] 

Let R0(x, y) , GO (x, y) , and BO (x, y) be display signal 
values corresponding to the actual bias at each pixel position 
of the projectors 3A and 3B, and Rb(x, y) , Gb(x, yj , and 
Bb(x, y) be display signal values corresponding to the set 
bias. Display signal values R*'(x, y) , G''(x, y) , and 
B'' (x, y) after bias correction are given by 

[0051] 
[Formula 7] 

R tt (x,y) = RXx, y ) + R b (x,y)-R 0 (x,y) 
G"(x,y) = G\x,y) + G b (x,y)-G 0 (x,y) 
B"(x,y) = B\x,y) + B b (x,y) - B 0 (x,y) 

[0052] 

Here, using tristimulus values X0 (x, y) , Y0 (x, y) , and 
Z0(x, y) of the actual bias, the display signal values 
R0(x, y) , G0(x, y) , and B0 (x, y) corresponding to the actual 
bias at each pixel position are given by 

[0053] 
[Formula 8] 
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[0054] 

In a similar way, using tristimulus values Xb(x, y) , 
Yb(x, y) , and Zb(x, y) , the display signal values Rb(x, y) , 
Gb(x, y) , and Bb(x, y) corresponding to the set bias at each 
pixel position are given by 
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[0055] 
[Formula 9] 
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[0056] 
[0057] 

As the tristimulus values X0 (x, y) , Y0 (x, y) , and 
Z0(x, y) of the actual bias, XYZ values measured near the 
central portion of the projectors 3A and 3B are used, as in 
measuring the color reproduction characteristics of the 
projectors 3A and 3B by the measurement system shown in 
FIG. 3. If the tristimulus values X0 (x, y) , Y0 (x, y) , and 
Z0(x, y) cannot be sufficiently accurately measured or fall 
outside the luminance range measurable by the measurement 
instrument, X0 (x, y) = Y0 (x, y) = Z0 (x, y) = 0 may be assumed. 
In the overlap region between the partial display images by 
the projectors 3A and 3B, XYZ values calculated as the sum of 
biases of the projectors 3A and 3B are used as the tristimulus 
values X0(x, y) , Y0 (x, y) , and Z0 (x, y) . 

[0058] 

The actual bias and set bias of the projectors 3A and 3B 
are measured or set in advance and stored in the bias 
correction units 13A and 13B. A plurality of bias data are 
stored in accordance with a change in characteristics of the 
projectors 3A and 3B or the difference in set bias setting 
method and appropriately rewritten. 
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[0059] 

[Data Distribution Units 14A and 14B] 

The data distribution units 14A and 14B distribute the 
color image data after bias correction, which are input from 
the bias correction units 13A and 13B, to display color image 
data in units of pixels. In this image data distribution, the 
color image data input to the data distribution units 14A and 
14B are corrected and distributed to the output side such 
that, in the overlap region between the partial display images 
by the projectors 3A and 3B, each of the partial display 
images included in the overlap region is displayed at 
a predetermined ratio. 

[0060] 

More specifically, this data distribution processing is 
performed by multiplying the signal values of display color 
image data after bias correction by distribution coefficients 
Kl(x, y) and K2 (x, y) so that the sum of display signal values 
of display color image data to be input to the projectors 
3A and 3B matches the sum of display signal values of original 
display color image data after bias correction, as shown in 
FIG. 8. 

[0061] 

That is, display signal values R'"l(x, y) , G'"l(x, y) , 
and B'''l(x, y) of RGB colors at the pixel position (x, y) , 
which are distributed to the projector 3A, are given by 
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[0062] 

[Formula 10] 

R m l(x,y) = Kl(x,y)R"(x,y) 
G"'l(x,y)=Kl(x,y)G"(x,y) 
2Tl(x,y) = Kl(x,y)B\x,y) 

[0063] 

In a similar manner, display signal values R'''2(x, y) , 
G'"2(x l y) , and B lfl 2(x, y) of RGB colors at the pixel 
position (x, y) , which are distributed to the projector 3B, 
are given by 

[0064] 

[Formula 11] 

R m 2(x,y) = K2(x,y)R"(x,y) 
G"'2(x,y) = K2(x,y)G"(x,y) 
B m 2(x,y) = K2(x,y)B"(x,y) 

[0065] 

for 

[0066] 
[Formula 12] 

K2(x,y) = l-Kl(x,y) 
[0067] 
[0068] 

Here, the distribution coefficients Kl(x, y) and K2 (x, y) 
are set to be smaller as the pixel position becomes far from 
the central position of the partial display images projected 
by the projectors 3A and 3B, as shown in FIG. 8. When 
a random number is added to any one of the distribution 
coefficients Kl (x, y) and K2 (x, y) set in the above-described 
way, and the distribution coefficients are re-calculated, the 



boundary between the partial display images in the overlap 

region due to a display error can be made unnoticeable . For 

example, on the basis of 

[0069] 

[Formula 13] 

KV(x,y) = Kl(x,y) + R(Kl(x,y)) 
K2'(x,y) = l-Kl'(x,y) 

[0070] 

the distribution coefficients Kl (x, y) and K2 (x, y) are 
re-calculated. Kl'(x, y) and K2'(x, y) are re-calculated 
distribution coefficients. R(x) is a random number within the 
following range. 

[0071] 
[Formula 14] 

-X <R(X)<\-X 

[0072] 

The distribution coefficients Kl(x,y ) and K2 (x, y) 
before re-calculation are set in advance in the 
data distribution units 14A and 14B. 

[0073] 

Processing from the color correction units 11A and 11B to 
the data distribution units 14A and 14B described above is 
summarized as follows. The input color image data R(x, y) , 
G(x, y) , and B(x, y) at the pixel position (x, y) are 
converted into display color image data R' ' ' (x, y) , 
G' ' ' {x, y) , and B' ' ' (x, y) as shown in the following formula. 
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[0074] 
[Formula 15] 

G m (x,y) 

= 0K(x,y)0 
00K(x,y)) 



x r x s x h 
z r z„z h 



a u a n a i3 
a 2l a 22 a 22 



R(x,y) 
G(x,y) 
{B(x,y) 



r K(x,y)) 

G h (x,y) 
,B h (x,y) 



r Ro(x,y) 
G 0 (x,y) 
,B 0 (x,y) 



[0075] 

Here, K is the distribution coefficient Kl (x, y) or 
K2(x, y) , or the re-calculated distribution coefficient 
Kl ' {x, y) or K2 ' (x, y) . 

[0076] 

[Gray Scale Correction Units 15A and 15B] 
The color image data R 1 1 ' (x, y) , G' ' ' (x, y) , and 
B' ' ' (x, y) output from the data distribution units 14A and 14B 
are input to the corresponding gray scale correction units 
15A and 15B. The gray scale correction units 15A and 15B 
execute gray scale correction on the display color image 
data R ' ' ' (x, y) , G' ' ' (x, y) , and B' 1 1 (x, y) output from the 
data distribution units 14A and 14B based on the following 
formula. 

[0077] 
[Formula 16] 

Rou, =r;\R"") 
g oui =r;\G"") 
b ou , =r- h \B"") 
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[0078] 

RGB data Rout, Gout, and Bou thus obtained is output to 
the projectors 3A and 3B as final display color image data. 
[0079] 

In this case, yc -1 (d) (c = r, g, b) is gray scale 
correction data as an inverse function of output luminance 
with respect to an input signal value d whose maximum value is 
normalized to 1. This gray scale correction data yc -1 (d) is 
obtained by measuring the display luminance of the projectors 
3A and 3B ranging from 0 to the maximum value of the input 
signal value of each of the RGB primary colors of the 
projectors 3A and 3B using the same measurement system as 
shown in FIG. 3, and stored in advance in the gray scale 
correction units 15A and 15B. 

[0080] 

To acquire the gray scale correction data yc -1 , 
a spectrophotometer, color difference colorimeter, luminance 
meter, or image sensing apparatus can be used. A method of 
acquiring gray scale correction data using 
a spectrophotometer, color difference colorimeter, or 
luminance meter for spot light measurement is accurate but 
time-consuming. To the contrary, according to a method of 
acquiring gray scale correction data using an image sensing 
apparatus, when a gradation pattern is displayed and sensed, 
the gray scale correction data can be acquired by one sensing 
operation. In this case, when the shading of the image 
sensing apparatus is corrected, more accurate data can be 
acquired. 



[0081] 
(Second Embodiment) 

FIG. 9 shows an arrangement of an image data conversion 
apparatus 2 in a color image display system according to the 
second embodiment of the present invention. The arrangement 
of the second embodiment is the same as in the first 
embodiment except the image data conversion apparatus 2, and 
a detailed description thereof will be omitted. 

[0082] 

The image data conversion apparatus 2 of this embodiment 
includes color correction units 11A and 11B, geometrical 
correction units 12A and 12B, bias correction units 16A and 
16B, data distribution units 14A and 14B, nonunif ormity 
correction units 17A and 17B, and gray scale correction units 
15A and 15B, which are prepared in correspondence with 
projectors 3A and 3B shown in FIG. 1. The arrangement of the 
image data conversion apparatus 2 of the present embodiment is 
the same as in the first embodiment except the bias correction 
units 16A and 16B and nonunif ormity correction units 17A and 
17B, and a detailed description thereof will be omitted. Only 
the bias correction units 16A and 16B and nonunif ormity 
correction units 17A and 17B will be described. 

[0083] 

[Bias Correction Units 16A and 16B] 
In this embodiment, bias correction by the bias 
correction units 16A and 16B is performed using bias 
data measured in units of pixels, thereby coping with a case 
in which the bias changes in units of pixels, unlike the first 
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embodiment. Here, display signal values RO (x, y) , GO (x, y) , 
and B0(x, y) of RGB colors corresponding to actual bias at 
each pixel position, which are obtained on the basis of 
a color image signals Rd(x, y) , Gd(x, y) , and Bd(x, y) 
obtained by sensing partial color images displayed by the 
projectors 3A and 3B with a digital camera, are calculated by 
the following formula. 

[0084] 
[Formula 17] 













G 0 (x,y) 




G r G g G b 




G d (x,y) 


B 0 (x,y) j 











[0085] 

Here, Rs, Gs, and Bs (s = r, g, b) are R signal value, G 
signal value, and B signal value, respectively, which are 
obtained by sensing, with a digital camera, colors in the 
maximum light emission by s primary colors of the projectors 
3A and 3B. If the display signal values RO (x, y) , GO (x, y) , 
and B0(x, y) cannot be sufficiently accurately measured or 
calculated, RO (x, y) = GO (x, y) = BO (x, y) = 0 may be assumed. 

[0086] 

[Nonunif ormity Correction Units 17A and 17B] 
This embodiment assumes that colors in the partial color 
images displayed by the projectors 3A and 3B are nonuniform 
due to the luminance difference between pixel positions. The 
luminance difference changes in units of RGB primary colors. 
Each primary color has a predetermined chromaticity value for 
each pixel position. In this case, image data R' 1 ' (x, y) , 



G' 1 ' (x, y) , and B'''(x, y) corresponding to the light emission 
colors of the RGB primary colors and display color image 
data R' ' ' ' (x, y) , G"" (x, y) , and B' ' ' ' {x, y) have a relation 
of the following formula. 

[0087] 
[Formula 18] 



(R"'(x,y)\ 




(k r (x,y)00^ 


(R""(x,y)\ 


G"\x,y) 




0k g (x,y)0 


G""(x,y) 


B'"(x,y) j 






B""(x,y) 



[0088] 

Here, kr(x, y) , kg(x, y) , and kb(x, y) are luminance 
nonunif ormities of the RGB primary colors. Hence, the display 
color image data R' ' ' 1 (x, y) , G ' ' ' ' (x, y) , and B ' ' ' ' (x, y) 
after the luminance nonunif ormities are corrected are 
expressed by the following formula. 

[0089] 
[Formula 19] 
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[0090] 
[0091] 

On the basis of the above formula, the nonunif ormity 
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correction units 17A and 17B correct color nonunif ormities by 
linear conversion using a color nonunif ormity correction 
coefficient l/ks{x, y) (s = r, g, b) that changes in units of 
pixel positions and RGB primary colors. Here, the value 
ks(x, y) is obtained from RGB primary color signals at each 
pixel position, which are obtained by sensing, with a digital 
camera, the display images in the maximum light emission of 
the RGB primary colors of the projectors 3A and 3B. However, 
a digital camera having a sensitivity characteristic linear 
with respect to luminance or signal values corrected to obtain 
linear sensing signals with respect to luminance are used. 

[0092] 
(Third Embodiment) 

FIG. 10 shows a color image display system according to 
the third embodiment of the present invention. This color 
image display system includes an image input apparatus 31, 
image data conversion apparatus 32, multi-primary-color 
projectors 33A and 33B, and screen 34. 

[0093] 

The image input apparatus 31 inputs image data having 
three channels per pixel, which is obtained by sensing 
an object using, e.g., a digital camera. The image input, 
apparatus 1 has a sensitivity characteristic linear with 
respect to luminance, and the input color image data is also 
linear with respect to luminance. The input color image 
data input by the image input apparatus 31 is output to the 
image data conversion apparatus 32. 
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[0094] 

The image data conversion apparatus 32 converts the input 
color image data from the image input apparatus 31 into 
display color image data for the two multi-primary-color 
projectors 33A and 33B serving as partial color image display 
means and outputs the image data to the corresponding 
multi-primary-color projectors 33A and 33B. 

[0095] 

The multi-primary-color projectors 33A and 33B are, e.g., 
6-primary-color projectors which project and display a partial 
color image on the screen 34 in accordance with 6-channel 
display color image data input from the image data conversion 
apparatus 32. The partial color images are synthetically 
displayed on the screen 34 as a large color image of one frame. 
In this case, the partial display images by the projectors 
33A and 33B partially overlap on the synthesized display image. 

[0096] 

Next, the image data conversion apparatus 32 will be 
described in detail with respect to FIG. 11. As shown in 
FIG. 11, the image data conversion apparatus 32 includes color 
correction units 41A and 41B, geometrical correction units 
42A and 42B, primary color luminance correction units 43A and 
43B, and gray scale correction units 44A and 44B, which are 
prepared in correspondence with the multi-primary-color 
projectors 33A and 33B. 

[0097] 

[Color Correction Units 41A and 41B] 

Input color image data within image regions displayable 



- 32 - 

by the multi-primary-color projectors 33A and 33B are input 
from the image input apparatus 31 to the color correction 
units 41A and 4 IB. The input color image data do not depend 
on the characteristics of the multi-primary-color projectors 
33A and 33B. The input image data are converted into display 
color image data having 6-channel signal values unique to the 
multi-primary-color projectors 33A and 33B in accordance with 
the color reproduction characteristics of the 
multi-primary-color projectors 33A and 33B. 
[0098] 

The color reproduction characteristics of the 
multi-primary-color projectors 33A and 33B are obtained, using 
the measurement system shown in FIG. 3, by causing the 
projectors 33A and 33B to project single-color images of the 
six primary colors onto the screen 34 on the basis of 
6-primary-color data {CI, C2, C3, C4, C5, and C6) , and 
measuring XYZ tristimulus values in the maximum light emission 
of these single-color images using a measurement instrument 
such as a spectrophotometer. 

[0099] 

The color reproduction characteristics obtained in the 
above manner are supplied to the color correction units 
41A and 41B. The color correction units 41A and 41B convert 
input color image data R, G, and B into display color image 
data (CI, C2, C3, C4, C5, and C6) by the following formula. 
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[0100] 



[Formula 20] 



(Cl\ 



C5 



C3 
C4 



C2 




[C6) 



[0101] 



Here, m(i)jk (i = 1 to 24, j = 1 to 6, and k = 1 to 3) is 
an element of a matrix M determined by the color reproduction 
characteristics of the projectors 33A and 33B, and (i) is 
determined by the data values of the input color image data R, 
G, and B. When the multi-primary-color projectors 33A and 33B 
are 6-primary-color projectors, 24 types of matrices are 
switched in accordance with the region occupied by the 
data values of the input color image data R, G, and B. In 
addition, aij is an element of a matrix A for converting the 
input color image data R, G, and B into XYZ values. 



A method of converting the XYZ values into 
multi-primary-color image data signals as display color image 
data by the color correction units 41A. and 41B is described in, 
e.g., Japanese Patent Application No. 11-048042 in detail. 
The matrices M and A are set or measured in advance to be 
stored in the color correction units 41A and 41B. 



[0102] 
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[0103] 

[Geometrical Correction Units 42A and 42B] 
Next, the display color image data (CI, C2, C3, C4, C5, 
and C6) corrected by the color correction units 41A and 41B 
are input to the geometrical correction units 42A and 42B. 
The geometrical correction units 42A and 42B perform 
geometrical correction on the basis of the display color image 
data (CI, C2, C3, C4, C5, and C6) such that the partial color 
images are projected at correct positions by 

multi-primary-color projectors 33A and 33B. Details of the 
geometrical correction are disclosed in Jpn. Pat. Appln. KOKAI 
Publication No. 9-326981, and a detailed description thereof 
will be omitted here. 
[0104] 

[Primary Color Luminance Correction Units 43A and 43B 
(Gain/Bias Correction Means + Data Distribution Means + 
Nonunif ormity Correction Means)] 

Next, the display signals (CI, C2, C3, C4, C5, and C6) 
which have undergbne the geometrical correction by the 
geometrical correction units 42A and 42B are input to the 
primary color luminance correction units 43A and 43B. The 
primary color luminance correction units 43A and 43B perform 
processing corresponding to gain/bias correction, 
data distribution, and nonunif ormity correction. The primary 
color luminance correction units 43A and 43B correct each 
primary color signal Cj (x, y) (j = 1 to 6) of each pixel on 
the basis of the following formula and outputs the signal to 
the gray scale correction units 44A and 44B. 
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[0105] 
[Formula 21] 

C'j (x,y) = a j (x,y)C j (x,y) + 0, (x,y) 
[0106] 

Here, ot j (x, y) and (3j (x, y) are correction coefficients 
used for all processes including bias correction, 
data distribution, and nonunif ormity correction. 

[0107] 

On the same assumption as in the second embodiment, the 
signal value C'j(x, y) (j = 1 to 6) after gain/bias correction, 
data distribution, and nonunif ormity correction is expressed 
by the following formula. 
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[0108] 
[Formula 22] 
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[0109] 

Hence, c*j (x, y) and (3j (x, y) are calculated by the 
following formulas. 

[0110] 
[Formula 23] 

'a.O^OOOOO^ fl/A^x^OOOOOY^^jOOOOOO^ 
0a 2 (jc,.y)0000 01/£ 2 (x,.y)0000 0K{x,y)0QQ0 
00a 3 (x,j;)000 _ 001/£ 3 (;c, j/)000 00K(x,y)000 
000a 4 (x,y)00 ~ 0001/£ 4 (*,.>;) 00 Q00K(x,y)0Q 
0000ar 5 (x,j/)0 00001/A: 5 (x,.y)0 0000 ^(x^O 
0 0 0 0 0a 6 (x, y) J [o 0 0 0 0 l/k 6 (x, y) ){o 0 0 0 0 K(x, y) J 
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[0111] 
[Formula 24] 
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[0112] 
[0113] 

Further, when the signal value C'j(x, y) (j = 1 to 6) is 
corrected by the following formula such that the display 
signal values C'j(x, y) (j - 1 to 6) are ((51, (52, (53, (54, (55, 
and (56) when the input color image data are (0, 0, 0) or (C'lw, 
C'2w, C'3w, C'4w, C'5w, and C'6w) when the input color image 
data are (Rw, Gw, Bw) , 

[0114] 
[Formula 25] 

C'j (x,y) = a'j (x,y)Cj (x,y) + J3 j( x,y) 

= Pj (x,y)cCj (x,y)Cj (x,y) + p j (x,y) 

[0115] 
we have 

[0116] 
[Formula 26] 

Pj (x,y) = iC) w (x,y)-fi / tx,yy)KajOc,yyC Jm tx,yy) 

[0117] 

where 



[0118] 
[Formula 27] 

C^(x,y)-i!:(x i yXC > (x,y)-C yo (x f y))/* y (x > y) 
[0119] 
[Formula 28] 



[0120] 
[0121] 

As described above, when the correction coefficients 
a'j(x, y) and (3j (x, y) are set, and gain correction is done by 
using the coefficient a'j(x, y) , and bias correction is done 
by using the coefficient pj (x, y) , a region where the input 
color image data has a smaller value than the bias and cannot 
be reproduced can be eliminated at a low-luminance portion, 
and color misregistration by bias correction can be prevented 
to enable accurate color reproduction at a high-luminance 
portion. FIG. 12 shows the state in which the color display 
image is accurately reproduced by gain correction and bias 
correction using the correction coefficients a'j(x, y) and 



[0122] 

[Gray Scale Correction Units 44A and 44B] 

The arrangement of the gray scale correction units 
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44A and 44B is the same as described in the first embodiment 
except that the number of correction data increases in 
correspondence with the six primary colors, and a detailed 
description thereof will be omitted. 

[0123] 
(Fourth Embodiment) 

Next, a color image display system according to the 
fourth embodiment of the present invention will be described 
with reference to FIGS. 13 and 14. The arrangement of the 
fourth embodiment is the same as that described in the first 
embodiment except projectors 3A and 3B and image 
data conversion apparatus 2, and a detailed description 
thereof will be omitted. 

[0124] 

In this embodiment, the image data conversion apparatus 2 
includes color correction units 51A and 51B and gray scale 
correction units 52A and 52B, which are prepared in 
correspondence with the projectors 3A and 3B, as shown in 
FIG. 13. The color correction unit 51A (51B) has not only the 
color correction function but also the bias correction and 
color nonuniformity correction functions and is constructed by 
a matrix correction unit 61 and bias correction unit 62, as 
shown in FIG. 14. 

[0125] 

[Matrix Correction Unit 61] 

Input color image data R(x, y) , G(x, y) , and B(x, y) 
within an image region displayable by the projectors 3A and 3B 
are input from an image input apparatus 1 to the matrix 
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correction unit 61. The input color image data R(x, y) , 
G(x, y) , and B(x, y) are converted, using a matrix M(x, y) 
corresponding to each pixel position (x, y) , which is shown in 
the following formula 

[0126] 
[Formula 29] 
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[0127] 

into matrix correction data R 1 (x, 

[0128] 
[Formula 30] 
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[0129] 

The matrix M(x, y) is calculated in advance by the 
following formula and stored in the matrix correction unit 61. 

[0130] 
[Formula 31] 

' M\ i (x, y)m n (x, y)m u (x, y) > 



m 2I (x, y)m 22 (x,y)m 23 (x, y) 
^ m 3 , (x, y)m 32 (x, y)m 33 (x,y)J 



' t n (x,y)t n (x,y)t u (x,y) s 


'K(x,y)00^ 


f x r x u x b ^ 




'a u a ]2 a n ' 




0K(x,y)0 


W 




a 2i a 22 a 23 


K t n (x,y)t 32 {x,y)t 33 (x,y) j 


00 K(x,yl 






a 3X a 32 a 33) 



[0131] 

Here, tji(x, y) is an element of a matrix T(x, y) for 
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PuPnPn 
{P31P32P33J 



nonunif ormity correction at the pixel position (x, y) , and the 
remaining notation is the same as in the first embodiment. 
The matrix T(x, y) is calculated by the following formula. 

[0132] 
[Formula 32] 

'tu(x,y)t u (x,y)t u (x, y y 

J 3l (x,y)t n (x,y)t 33 (x,y) y 

q 2 i(x,y)q 22 (x,y)q 23 (x,y) 
,?3I (*> y)i32 (*» y)i33 (*> y), 

[0133] 

Here, qji(x, y) is an element of a matrix Q(x, y) for 
converting a display image by an i signal of the projector at 
the pixel position (x, y) into a sensing signal of the j-th 
channel, which is sensed by a digital camera. The matrix 
Q(x, y) is calculated by the following formula on the basis of 
image data obtained by sensing, with a digital camera, 
an image of each color, which is displayed on the full screen 
while setting the input signals to the projectors 3A and 3B as, 
e.g., signals 1 (255, 0, 0), 2 (0, 255, 0), and 3 (0, 0, 255). 

[0134] 
[Formula 33] 

'<iu(x,y)q l2 (x,y)q l3 (x,y)^ 
<l 2i (x,y)q 22 (x,y)q 23 (x,y) -- 

S3 1 (*. y) < i32 (*. y)<i33 (*» y) , 

[0135] 

Here, RkGkBk (k = 1 to 3) are RGB signals obtained by 
sensing the k-th display image, and pji is an element of 



(R 1 (x,y)R 2 (x,y)R 3 (x,y)) 

G x (x,y)G 2 (x,y)G 3 (x,y) 
{B,(x,y)B 2 (x,y)B 3 (x,y) 



255 00 
02550 
00255 



a matrix P for converting a partial color image displayed on 
the basis of the i signal of the projector at the standard 
position into an image signal of the j-th channel, which is 
sensed by a digital camera. 
[0136] 

The matrix P is calculated by the following formula on 
the basis of image data obtained by sensing, with a digital 
camera, an image of each color, which is displayed at the 
standard position while setting the input signals to the 
projectors 3A and 3B as, e.g., signals 1 (255, 0, 0), 
2 (0, 255, 0), and 3 (0, 0, 255). 

[0137] 
[Formula 34] 







f^W*3 \ 


/255 0 0\ 






G,G 2 Gi 


02550 






{ B 1 B 2 B 3 j 


0 0 255 j 



[0138] 

Here, RkGkBk (k = 1 to 3) are RGB signals obtained by 
sensing the k-th display image. Display images of the 
projectors 3A and 3B used to calculate the matrix Q(x, y) and 
matrix P are optional as far as the display images are 
displayed by input signals of three independent colors. 

[0139] 

[Bias Correction Unit 62] 

The matrix correction data R' (x, y) , G' (x, y) , and 
B' (x, y) are output to the bias correction unit 62. The bias 
correction unit 62 subtracts, from the matrix correction 
data R' (x, y) , G'(x, y) , and B'(x, y) , bias data N(x, y) 
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which is obtained 



corresponding to the pixel position (x, y) , 
by 

[0140] 
[Formula 35] 

N(x,y) = n g (x,y) 
^ h (x,y) / 

[0141] 

to calculate bias correction data R' 1 (x, y) , G' ' (x, y) , 
B'' (x, y) as shown in the following formula. 

[0142] 
[Formula 36] 







r R\x,y^ 




r n r {x,y)^ 


G\x,y) 




G\x,y) 




n g {x,y) 


{B\x,y)j 




B\x,y), 
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[0143] 

The bias data N(x, y) is calculated in advance by the 
following formula and stored in the bias correction unit 62. 

[0144] 
[Formula 37] 

n r (x,y) 
n g (x,y) 
{n h (x,y)J 
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G b (x,y) 




G 0 (x,y) 




){00K(x,y)) 






B 0 {x,y)j 


) 



[0145] 

In this manner, the bias correction data R" (x, y) , 
G" (x, y) , and B" (x, y) output from the color correction units 
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51A and 51B are input to the gray scale correction units 
52A and 52B. The arrangement of the gray scale correction 
units 52A and 52B is the same as that described in the first 
embodiment, and a detailed description thereof will be omitted. 
[0146] 

[Projectors 3A and 3B] 

Next, a preferred arrangement of the projectors 3A and 3B 
used in this embodiment will be described. The projectors 
3A and 3B described hereinafter are designed to make the 
display luminance of each partial display image lower in the 
overlap region between the partial display images by the 
projectors 3A and 3B than in the remaining region (the single 
display region of each partial display image) . 

[0147] 

FIGS. 15(a) and 15(b) show arrangement examples of the 
projectors 3A and 3B. Each of the projectors 3A and 3B 
includes a light source 71, a collimator lens 72, an ND filter 
73A (73B), aluminum mirrors 74, 75, 78, and 79 as total 
reflection mirrors, half mirrors 76 and 77, a prism 80, an R 
liquid crystal panel 81 having an R filter, G liquid crystal 
panel 82 having a G filter, and B liquid crystal panel 83 
having a B filter, which oppose the three light incident 
surfaces of the prism 80, and an optical system 84 including 
a projection lens. 

[0148] 

In the projector 3A, light from the light source 71 is 
collimated through the collimator lens 72, transmitted, through 
the ND filter 73A, reflected by the aluminum mirror 74, and 
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then becomes incident on the half mirror 77, as shown in 
FIG. 15(a). The half mirror 77 passes the red spectral 
component of the incident light and reflects the remaining 
spectra . 

[0149] 

A transmitted light Rl from the half mirror 77 is 
reflected by the aluminum mirror 79 and transmitted through 
the R liquid crystal panel 81 and then becomes incident on the 
prism 80. The reflected light from the half mirror 77 becomes 
incident on the half mirror 76. The half mirror 76 reflects 
the green spectral component of the incident, light and passes 
the blue spectral component. A reflected light Gl from the 
half mirror 76 is transmitted through the G liquid crystal 
panel 82 and becomes incident on the prism 80. A transmitted 
light Bl from the half mirror 76 is sequentially reflected by 
the aluminum mirrors 75 and 78 and transmitted through the B 
liquid crystal panel 83 and then becomes incident on the 
prism 80. 

[0150] 

In the above manner, the light Rl, Gl, and Bl incident on 
the prism 80 is synthesized by the prism 80. The exit light 
is projected onto the screen 4 through the optical system 84 
to display a partial color image. The projector 3B has the 
same arrangement as that of the projector 3A except that the 
ND filter 73B is different from the ND filter 73A, as shown in 
FIG. 15 (b) . 

[0151] 

FIG. 16 shows the transmittance distribution of the ND 
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filter 73A in the projector 3A and that of the ND filter 73B 
in the projector 3B. As shown in FIG. 16, the ND filters 
73A and 73B have symmetric transmittance distributions. In 
the overlap region between the partial color images displayed 
by the projectors 3A and 3B, the transmittance decreases, 
toward the edge. 
[0152] 

This makes it possible to reduce the increase in. bias in 
the overlap region between the partial color images displayed 
by the projectors 3A and 3B and consequently avoid any 
increase in luminance in the overlap region relative to that 
in the single display region. 

[0153] 

FIG. 17 shows biases when the projectors 3A and 3B have 
no ND filters as a comparative example. If the projectors 
3A and 3B have the same bias, the bias in the overlap region 
of the partial color images is twice that at the portion 
(single display region) where a single partial color image is 
displayed by the projector 3A or 3B. 

[0154] 

To the contrary, when the projectors 3A and 3B have the 
ND filters 73A and 73B having transmittance distributions 
shown in FIG. 18(a) in accordance with this embodiment, the 
bias in the overlap region equals that in the single display 
region, as shown in FIG. 18(a). 

[0155] 

When the projectors 3A and 3B have different biases, 
a bias distribution as shown in FIG. 18(b) is obtained by 
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using ND filters having transmittances shown in FIG. 13. If 
the transmittance corrected portion of the ND filters 
completely matches the overlap region of the partial display 
images, the discontinuity of the bias in the overlap region 
can be improved as described above. 
[0156] 

If the transmittance corrected portion of the ND filters 
does not completely match the overlap region of the partial 
display images, and the overlap region is narrower than the 
transmittance corrected portion, the bias value becomes 
smaller than the ideal bias value, as shown in FIG. 18(c). 

[0157] 

In addition, if the overlap region is wider than the 
transmittance corrected portion of the ND filters, the bias 
value becomes larger than the ideal bias value, as shown in 
FIG. 18 (d) . 

[0158] 

As described above, even when the transmittance corrected 
portion of the ND filters and the overlap region of the 
partial display images do not completely match, the 
discontinuity of bias can be improved as compared to a case 
without correction. 

[0159] 

Next, other arrangement examples of the projectors 3A and 
3B will be described with reference to FIGS. 19 to 22. 
FIG. 19 shows the projector 3A, though this also applies to 
the projector 3B. 
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[0160] 

A description will be made using the same reference 
numerals as in FIG . 15. Referring to FIG. 15, the ND filter 
73A is arranged immediately behind the collimator lens 72. 
However, referring to FIG. 19, the ND filter 73A is inserted 
between the aluminum mirror 74 and the half mirror 77. 
Referring to FIG. 20, the ND filter 73A is inserted between 
the prism 80 and the optical system 84. In addition, 
referring to FIG. 21, three ND filters 73A are inserted 
between the prism 80 and the liquid crystal panels 81, 82, and 
83. 

[0161] 

In any example of the projectors shown in FIGS. 15, and 
19 to 21, the position of the ND filter can be easily changed 
to set its direction such that the transmittance corrected 
portion corresponds to the overlap region between the partial 
display image by one projector having the ND filter and the 
partial display image by the other projector. 

[0162] 

In the projector 3A shown in FIG. 22, a complete 
light-shielding plate 85 is located at an end portion between 
the prism 80 and the optical system 84 in place of the ND 
filter, thereby dimming light corresponding to the overlap 
region of the partial display images by the projectors 3A and 
3B. 

[0163] 

The embodiments of the present invention have been 
described above. However, the present invention is not 
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limited to the above-described embodiments, and various 
changes and modifications can be made, as will be described 
below . 

[0164] 

(a) In the above embodiments, the input color image 
data is RGB image data input by the image input apparatus. 
However, the present invention is not limited to this, and XYZ 
image data or display signal values in the partial color image 
display means may be used. 

(b) In the above embodiments, the case in which 

a reflection-type projector is used as a partial color image 
display means was described. However, the present invention 
is not limited to this and can also be applied to a case in 
which a display apparatus of another scheme, such as a rear 
(back projection type) projector, CRT display, or liquid 
crystal display, is used as the partial color image display 
means . 

[0165] 

(c) In the above embodiments, as a plurality of partial 
color image display means, two 3-primary-color projectors or 
two 6-primary-color projectors are used. However, the number 
of display means and the number of primary colors are not 
limited to specific values. For example, four 6-primary-color 
projectors may be used as the partial color image display 
means . 

[0166] 

(d) In the above embodiments, it was described that 
data used to correct the difference in color reproduction 
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characteristic between the partial color image display means 
by the color correction means is obtained by measurement using 
a spectrophotometer. Instead of the spectrophotometer, 
a digital camera may be used. In this case, if the spectral 
sensitivity characteristic of the digital camera is 
represented by linear conversion of a color matching function, 
the data for correcting the difference in color reproduction 
characteristic between the display apparatuses can be 
accurately measured. Further, in place of the 
spectrophotometer, the color difference colorimeter or 
illuminance meter may be used. 
[0167] 

(e) In the above embodiments, it was described that the 
color correction means performs 3 * 3 matrix conversion or 
conversion from three primary colors into multiple primary 
colors. Instead, color conversion based on another scheme, 
e.g., conversion using a neural network, non-linear conversion 
including a term of higher order, conversion using 

a three-dimensional lookup table and interpolation may be 
executed. In any case, it is important that the color 
correction means uses data obtained by measuring the color 
reproduction characteristic data of each partial color image 
display means for each of the color image display means. 
[0168] 

(f) In the above embodiments, as described in, e.g., the 
second embodiment, the distribution coefficients Kl (x, y) and 
K2 (x, y) having linear distributions as shown in FIG. 8 are 
used by the data distribution units 14A and 14B. However, 
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distribution coefficients having curve distributions as shown 
in FIG. 23, which spatially smoothly change in the overlap 
region between the partial display images by the projectors 
3A and 3B as the partial color image display means, may be 
used . 

[0169] 

(g) In the above embodiments, in the projector 3A shown 
in FIG. 22, it is described that a complete light-shielding 
plate is located at an end portion between the prism and the 
optical system. However, the position of the light-shielding 
plate is not limited to this and may be between the optical 
system and the screen. 

[0170] 

Preferred implementations of the present invention 
disclosed in the above-described embodiments will be listed 
below . 

(1) A color image display system including: 
a plurality of partial color image display means for, 
upon receiving display color image data, displaying partial 
color images to be synthetically displayed as a color image of 
one frame; and 

an image data conversion means for converting input color 
image data into the display color image data to be input to 
the partial color image display means, characterized in that 

the image data conversion means includes a color 
correction means for correcting a difference in color 
reproduction characteristic between the partial color image 
display means. 
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(1-1) The color image display system according to (1), 
characterized in that the color correction means performs 
correction on the input color image data, including non-linear 
conversion . 

(1-2) A color image display system according to (1), 
characterized in that the color correction means includes 
a data acquisition means for acquiring data to be used to 
correct the color reproduction characteristics. 

(1-3) A color image display system according to (1-2), 
characterized in that the data acquisition means includes at 
least any of the spectrophotometer, color difference 
colorimeter, image sensing means, and illuminance meter. 

[Effects] Even when the plurality of partial color image 
display means have different color reproduction 
characteristics, displayed colors match in the entire color 
image synthetically displayed as one frame. Hence, 
discontinuous connected parts between the partial color images 
are eliminated, and a high-quality color image can be 
displayed as a whole. 

[0171] 

(2) A color image display system including: 
a plurality of partial color image display means for, 
upon receiving display color image data, displaying partial 
color images to be synthetically displayed as a color image of 
one frame; and 

an image data conversion means for converting input color 
image data into the display color image data to be input to 
the partial color image display means, characterized in that 



the image data conversion means includes a correction 
means for correcting a bias of the input color image data so 
as to display the partial color images on a predetermined set 
bias in the partial color image display means. 

(2-1) The color image display system according to (2), 
characterized in that the set bias has a predetermined value. 

(2-2) The color image display system according to (2) or 
(2-1), characterized in that the set bias is one of actual 
biases of the partial color image display means, with which 
the projective vector to a predetermined color vector is 
maximized. 

(2-3) The color image display system according to any one 
of (2), (2-1), and (2-2), characterized in that the set bias 
is calculated from all color image data input to the 
correction means and the bias in the total display region of 
the partial color image display means. 

(2-4) The color image display system according to any one 
of (2) to (2-3), characterized in that the set bias is 
calculated on the basis of the difference vector in projective 
vector to a predetermined color vector between the color image 
data input to the correction means and the actual bias of the 
partial color image display means. 

(2-5) The color image display system according to any one 
of (2-2) to (2-4), characterized in that the predetermined 
color vector is the white vector of the partial color image 
displayed by the partial color image display means. 

(2-6) The color image display system according to (2), 
characterized in that the set bias spatially smoothly changes. 



(2-7) The color image display system according to any one 
of (2) to (2-6) , characterized in that the correction means 
corrects the input image data so as to accurately reproduce 
a predetermined color (in the above example, (C'lw, C*2w, C ' 3w 
C'4w, C'5w, and C'6w)) of the image displayed by the color 
image display means. 

(2-8) The color image display system according to (2-7), 
characterized in that the correction means performs not only 
bias correction but also gain correction on the input color 
image data in units of primary colors. 

[0172] 

[Effects] A case in which the display color image 
data input to the partial color image display means has 
a value smaller than the bias and cannot be reproduced is 
eliminated or reduced. 

In addition, when the set bias is calculated from the all 
input color image data and all biases in the display region, 
the set bias can be minimized, and color misregistration by 
the set bias can be minimized. Furthermore, a case in which 
the display color image data input to the partial color image 
display means has a value smaller than the bias and cannot be 
reproduced is eliminated or reduced. 

Further, a predetermined color of an image displayed by 
the color image display means configures to be reproduced 
accurately, thereby enabling accurate color reproduction as 
a color of the image becomes closer to the predetermined color 
In addition, a case in which the display color image data has 
a value smaller than the bias of the partial color image 
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display means and cannot be reproduced is eliminated or 
reduced . 

[0173] 

(3) A color image display system including: 
a plurality of partial color image display means for, 
upon receiving display color image data, displaying partial 
color images to be synthetically displayed as a color image of 
one frame; and 

an image data conversion means for converting input color 
image data into the display color image data to be input to 
the partial color image display means, characterized in that 

the image data conversion means includes 
a data distribution means for distributing the input color 
image data to the display color image data to be input to the 
partial color image display means so as to display, at 
a predetermined ratio in an overlap region, the partial color 
images contained in the overlap region between the partial 
color images displayed by the partial color image display 
means . 

(3-1) The color image display system according to (3), 
characterized in that the data distribution means distributes 
the input color image data to the display color image data to 
be input to the partial color image display means by reducing 
the ratio toward an end of each partial color image displayed 
by the partial color image display means. 

(3-2) The color image display system according to (3) or 
(3-1) , characterized in that the data distribution means 
distributes the input color image data to the display color 



image data to be input to the partial color image display 
means using a random number. 
[0174] 

[Effects] Even in the overlap region where the partial 
color images displayed by the plurality of partial color image 
display means overlap, a desired color can be accurately 
displayed . 

• In addition, when the input color image data is 
distributed to the display color image data to be input to the 
partial color image display means by reducing the ratio toward 
an end of each partial color image, generation of 
discontinuous connected parts due to the color difference 
between the partial color images by the partial color image 
display means can be relaxed. 

Furthermore, when the color image data is distributed . 
using a random number, generation of discontinuous connected 
parts due to the color difference between the partial color 
images by "the partial color image display means can be more 
effectively relaxed. 
[0175] 

(4) A color image display system including: 
a plurality of partial color image display means for, 
upon receiving display color image data, displaying partial 
color images to be synthetically displayed as a color image of 
one frame; and 

an image data conversion means for converting input color 
image data into the display color image data to be input to 
the partial color image display means, characterized in that 
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the image data conversion means includes a nonunif ormity 
correction means for correcting a color nonunif ormity in 
partial color image displayed by the partial color image 
display means. 

(4-1) The color image display system according to (4), 
characterized in that the nonunif ormity correction means 
corrects the color nonunif ormity using image data sensed by 
a digital camera. 

(4-2) The color image display system according to (4) or 
(4-1), characterized in that the nonunif ormity correction 
means corrects the color nonunif ormity by correcting 
a luminance nonunif ormity in each primary color of the partial 
color image displayed by the partial color image display means. 

(4-3) The color image display system according to any one 
of (4), (4-1), and (4-2), characterized in that the 
nonunif ormity correction means corrects the color 
nonunif ormity by linear conversion using a color nonunif ormity 
correction coefficient which is obtained on the basis of 
primary color image data obtained by sensing a display image 
of each primary color with a digital camera. 

[0176] 

[Effects] When the partial color image displayed by each 
partial color image display means is corrected, high-quality 
display is done in each partial color image, and also 
generation of discontinuous boundaries between the partial 
color images due to the color nonunif ormity which changes in 
units of partial color image display means can be prevented. 

In addition, when the color nonunif ormity is corrected by 
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using image data obtained by sensing with a digital camera, 
nonunif ormity correction can be performed at a level of units 
of pixels. In this case, if the color nonunif ormity is caused 
by a luminance nonunif ormity of each primary color, data for 
color nonunif ormity correction can be measured using a digital 
camera having an optional spectral sensitivity characteristic. 

Furthermore, when the color nonunif ormity is corrected by 
linear conversion using a color nonunif ormity correction 
coefficient obtained on the basis of primary color image 
data obtained by sensing the display image of each primary 
color with a digital camera, color nonunif ormities with 
chromaticity values changing in units of primary colors can 
also be corrected. 

[0177] 

(5) A color image display system including: 
a plurality of partial color image display means for, 
upon receiving display color image data, displaying partial 
color images to be synthetically displayed as a color image of 
one frame; and 

an image data conversion means for converting input color 
image data into the display color image data to be input to 
the partial color image display means, characterized in that 

the partial color image display means is designed to 
display the partial color images with display luminance lower 
in an overlap region between the partial color image displayed 
by one partial color image display means and the partial color 
image displayed by the other partial color image display means 
than in a remaining region. 
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(5-1) The color image display system according to (5) , 
characterized in that each partial color image display means 
has an ND filter whose transmittance becomes low in the 
overlap region. 

(5-2) The color image display system according to (5), 
characterized in that the partial color image display means 
lowers the display luminance in the overlap region by eclipse 
by a light-shielding member inserted in the optical path. 

[0178] 

[Effects] When the partial color image display means are 
designed to lower the display luminance in the overlap region 
between the partial color images, an increase in bias in the 
overlap region can be eliminated or reduced. 

In this case, when an ND filter whose transmittance 
becomes low in the overlap region is used, such a partial 
color image display means for lowering the display luminance 
in the overlap region can be easily implemented. 

In addition, when the display luminance is lowered in the 
overlap region by eclipse by the light-shielding member 
inserted in the optical path, such a partial color image 
display means for lowering the display luminance in the 
overlap region can be implemented at low cost. 

[0179] 

(6) The color image display system according to any one 
of (1) to (5), characterized in that each partial color image 
display means includes a multi-primary-color display having at 
least four primary colors. 
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[0180] 

[Effects] When a multi-primary-color display is used as 
the partial color image display means, a larger color 
reproduction region can be realized. 

[0181] 

[Advantage of the Invention] 

As has been described above, according to the present 
invention, in the data conversion apparatus for converting 
input color image data into display color image data to be 
input to the partial color image display means, color 
correction, bias correction, data distribution, color 
nonunif ormity correction, and so on are performed, or the 
plurality of partial color image display means are designed to 
lower the display luminance of each partial color image in the 
overlap region between the partial color images displayed by 
the partial color image display means. Thus, a plurality of 
partial color images can be synthetically displayed as a color 
image of one frame having satisfactory quality. 
[Brief Description of the Drawings] 

[FIG. 1] 

A diagram showing a schematic arrangement of a color 
image display system according to a first embodiment of the 
present invention. 

[FIG. 2] 

A diagram showing an internal arrangement of an image 
data conversion apparatus of the same embodiment. 
[FIG. 3] 

A view showing a measurement system of a color 
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reproduction characteristic of projectors. 
[FIG. 4] 

A diagram showing an internal arrangement of a color 
correction unit of the same embodiment. 
[FIG. 5] 

A view showing partial display images by each of the 
projectors and bias distribution of a synthesized display 
image thereof in the same embodiment. 

[FIG. 6] 

Views showing a variety of examples of a set bias in the 
same embodiment . 
[FIG. 7] 

A view schematically showing an actual bias and image 
data, which are projected onto a white axis in the same 
embodiment . 

[FIG. 8] 

A view showing distribution of distribution coefficients 
of data distribution units of the same embodiment. 
[FIG. 9] 

A diagram showing an internal arrangement of an image 
data conversion apparatus according to a second embodiment of 
the present invention. 

[FIG. 10] 

A diagram showing a schematic arrangement of a color 
image display system according to a third embodiment of the 
present invention. 

[FIG. 11] 

A diagram showing an internal arrangement of an image 
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data conversion apparatus of the same embodiment. 
[FIG. 12] 

A view showing the concept of gain/bias correction in the 
same embodiment. 
[FIG. 13] 

A diagram showing an internal arrangement of an image 
data conversion apparatus according to a fourth embodiment of 
the present invention. 

[FIG. 14] 

A diagram showing an internal arrangement of the color 
correction unit in the same embodiment. 
[FIG. 15] 

Views showing arrangement examples of the projectors in 
the same embodiment. 
[FIG. 16] 

A view showing transmittance distribution of ND filters 
installed in the projectors. 
[FIG. 17] 

A view showing distribution of a synthetic bias by the 
projector having the ND filter with the transmittance 
distribution shown in FIG. 16. 

[FIG. 18] 

Views showing synthetic bias distribution in a variety of 
conditions . 

[FIG. 19] 

A view showing another arrangement example of the 
projector in the same embodiment. 



[FIG. 20] 

A view showing still another arrangement example of the 
projector in the same embodiment. 
[FIG. 21] 

A view showing still another arrangement example of the 
projector in the same embodiment. 
[FIG. 22] 

A view showing still another arrangement example of the 
projector in the same embodiment. 
[FIG. 23] 

A view showing another distribution of distribution 
coefficients of a data distribution unit. 
[Explanation of Reference Symbols] 

1, 31 ... Image input apparatus, 

2, 32 ... Image data conversion apparatus 

(image data conversion means), 
3A, 3B, 33A, 33B ... Projector 

(partial color image display means) , 
4, 34 ... Screen, 

11A, 11B ... Color correction unit 

(color correction means) , 
12A, 12B ... Geometrical correction unit, 
13A, 13B, 16A, 16B ... Bias correction unit 

(bias correction means) , 
14A, 14B ... Data distribution unit 

(data distribution means), 
15A, 15B ... Gray scale correction unit, 
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17A, 17B ... Nonunif ormity correction unit 

(nonunif ormity correction means) , 
41A, 41B ... Color correction unit 

(color correction means) , 
42A, 42B ... Geometrical correction unit, 
43A, 43B ... Primary color luminance correction unit 

(bias correction means, data distribution 
means, nonunif ormity correction means) , 
44A, 44B ... Gray scale correction unit, 
51A, 51B ... Color correction unit 

(color correction means, bias correction 
means, nonunif ormity correction means) , 
52A, 52B ... Gray scale correction unit, 
73A, 73B ... ND filter, 
85 ... Light-shielding plate. 
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[Document] ABSTRACT 
[Abstract] 

[Object] A color image display system capable of 
synthetically displaying a plurality of partial color images 
as an image of one frame with satisfactory image quality is 
provided . 

[Means for Achieving the Object] In a color image display 
system that converts input color image data from an image 
input apparatus 1 by an image data conversion apparatus 2, 
inputs the display color image data to projectors 3A and 3B 
for partial color image display, and synthetically displays 
partial color images as color images of one frame on a screen 
4, characterized in that the image data conversion apparatus 2 
includes color correction units for correcting a difference in 
color reproduction characteristic between projectors 3A and 
3B, bias correction units for correcting a bias so as to 
display the partial color images on a predetermined set bias, 
data distribution units for distributing image data to 
display, at a predetermined ratio, each of the partial color 
images contained in a overlap region between the partial color 
images, and nonunif ormity correction units for correcting 
color nonunif ormities in each of the partial color images. 
[Elected Figure] FIG. 1 



